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Dialogic Reading 


Program Description * 1 Dialogic reading is an interactive shared picture-book reading 

practice designed to enhance young children’s language and 
literacy skills. During the shared reading practice, the adult and 

the child switch roles so that the child learns to become the 
storyteller with the assistance of the adult, who functions as an 
active listener and questioner. 


Research 2 Two studies of dialogic reading that fall within the scope of the 
Early Childhood Education Interventions for Children with Dis- 
abilities review protocol meet What Works Clearinghouse (WWC) 
evidence standards. The two studies included 52 students with 
language delays, from ages three to six, participating in early 
childhood programs in the Pacific Northwest. 3 Both studies 
examined intervention effects on children’s communication and 
language competencies. 


Based on these two studies, the WWC considers the extent of 
evidence for dialogic reading to be small for communication and 
language competencies for children with disabilities. No studies 
that meet WWC evidence standards with or without reservations 
examined the effectiveness of dialogic reading for children with 
disabilities in the domains of cognitive development, literacy, 
math competencies, social-emotional development and behav- 
ior, functional abilities, or physical well-being. 


Effectiveness 


Dialogic reading was found to have potentially positive effects on communication and language competencies for children 
with disabilities. 


1. Dialogic reading does not have a single developer or official description. The descriptive information for this program was adapted from publicly 
available sources: descriptions of this practice (see the websites listed under Additional Program Information) and research articles. This practice also 
is reviewed in the WWC intervention report for the general population as part of the Early Childhood Education topic area. Two related practices are 
reviewed in the Early Childhood Education WWC intervention reports on Interactive Shared Book Reading and Shared Book Reading. 

2. The studies in this report were reviewed using WWC Evidence Standards, Version 2.0 (see the WWC Procedures and Standards Handbook, Chapter III). 

3. The evidence presented in this report is based on available research. Findings and conclusions may change as new research becomes available. 
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Effectiveness (continued) 
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Additional program 
information 


Developer and contact 

Dialogic reading is a practice that does not have a single devel- 
oper responsible for providing information or materials. However, 
readers interested in using dialogic reading practices in their 
classrooms can refer to sources available through Internet 
searches for information. A list of examples follows, although 
these sources have not been reviewed or endorsed by the WWC: 

• Pearson School: http://www.pearsonschool.com/index.cfm7lo 
cator=PSZ16i&PMDbSiteld=2781&PMDbSolutionld=6724&PM 
DbSubSolutionld=6733&PMDbCategoryld=3289&PMDbProgr 
amld=22109&level=4 

• Committee for Children: http://www.cfchildren.org/programs/ 
ww/overview/ 

• Reading Rockets: http://www.pbs.org/launchingreaders/ 
rootsofreading/meettheexperts_2.html 

• American Library Association: http://www.ala.org/ala/mgrps/ 
divs/alsc/ecrr/index.cfm 

• Washington Learning Systems: http://www.walearning.com/ 
language/dialogic-reading/ 

Scope of use 

Dialogic reading was created in the 1980s, and the first 
published study appeared in 1988 (Whitehurst et al., 1988). 5 


Information on the number or demographics of children or 
centers using this intervention is not available. 

Teaching 

Dialogic reading can be used by teachers and other adults with 
children individually or in small groups. Adults can be trained 
in the principles of dialogic reading through video followed by 
role-playing and group discussion. While reading books with the 
child, the adult uses five types of prompts (forming the acronym 
“CROWD”): 

• Completion: The child fills in the blank at the end of a 
sentence. 

• Recall: The adult asks questions about a book the child has 
read. 

• Open-ended: The adult encourages the child to tell what is 
happening in a picture. 

• Wh-: The adult asks wh- questions about the pictures in the 
books. 

• Distancing: The adult relates pictures and words in the book 
to the child’s own experiences outside the book. 

Children should be allowed sufficient time to respond to ques- 
tions and prompts. 


4. These numbers show the average and range of student-level improvement indices for all findings across the studies. 

5. Whitehurst, G. J., Falco, F. L., Lonigan, C. J., Fischel, J. E., DeBaryshe, B. D., Valdez-Menchaca, M. C., & Caulfield, M. (1988). Accelerating language 
development through picture book reading. Developmental Psychology, 24(4), 552-559. 


WWC Intervention Report Dialogic Reading 


April 2010 


2 




Additional program These prompts are used by the adult in a reading technique 
information (continued) called PEER. The adult does the following: 

• Prompts the child to say something about the book 

• Evaluates the response 

• Expands the child’s response 

• Repeats the prompt 

As the child becomes increasingly familiar with a book, the adult 
reads less, listens more, and gradually uses higher level prompts 


to encourage the child to progress beyond naming the objects 
in the pictures to thinking more about what is happening in the 
pictures and how this relates to the child’s own experiences. 

Cost 

Published dialogic reading procedures are freely available to the 
public. Information is not available about the costs of training for 
and implementation of dialogic reading. 


Research Fifty-nine studies reviewed by the WWC investigated the effects 

of dialogic reading on children with disabilities. Two studies 
(Crain-Thoreson & Dale, 1999; Dale, Crain-Thoreson, Notari- 

Syverson, & Cole, 1996) are randomized controlled trials that 
meet WWC evidence standards. The remaining 57 studies do 
not meet either WWC evidence standards or eligibility screens. 

Meets evidence standards 

Comparisons meeting evidence standards in Crain-Thoreson 
and Dale (1999) included 19 three- to five-year-old children with 
mild to moderate language delays from five classrooms in three 
school districts in the Pacific Northwest. This study compared 
two intervention groups— a staff-implemented dialogic reading 
group and a parent-implemented dialogic reading group— to 
a comparison group that did not receive one-on-one dialogic 
reading. This report focuses on the comparison of communica- 
tion and language outcomes between the parent-implemented 
group and the no-treatment comparison group. The comparison 
between the staff-implemented group and the no-treatment 
comparison group did not meet evidence standards because of 


high differential attrition and lack of baseline equivalence and is 
excluded from this report. * * * * * 6 

Dale et al. (1996) included 33 three- to six-year-old children 
with mild to moderate language delays from early childhood 
education programs at the University of Washington. This study 
compared communication and language outcomes for children 
whose mothers were trained in and asked to implement dialogic 
reading with those for children whose mothers were trained in 
and asked to implement the Conversational Language Training 
Program, an intervention which is similar to dialogic reading 
in its emphasis on an interactive style of communication with 
children but does not involve book reading. 

Extent of evidence 

The WWC categorizes the extent of evidence in each domain 
as small or medium to large (see the WWC Procedures and 
Standards Handbook, Appendix G). The extent of evidence 
takes into account the number of studies and the total sample 
size across the studies that meet WWC evidence standards with 
or without reservations. 7 


6. The Crain-Thoreson and Dale (1999) study was previously reviewed in the WWC’s intervention report on dialogic reading as part of the Early Child- 
hood Education (ECE) review of interventions for the general population. Results pertaining to the parent-implemented dialogic reading group were 
excluded from the previous review, because the ECE review focused exclusively on center-based interventions. In the previous review (based on WWC 
Version 1.0 study attrition standards), the WWC downgraded the Crain-Thoreson and Dale (1999) study, because differential attrition between the staff- 
implemented dialogic reading and the comparison group was high. 

7. The extent of evidence categorization was developed to tell readers how much evidence was used to determine the intervention rating, focusing on 
the number and size of studies. Additional factors associated with a related concept-external validity, such as the students’ demographics and the 
types of settings in which studies took place-are not taken into account for the categorization. Information about how the extent of evidence rating was 
determined for dialogic reading is in Appendix A5. 
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Research (continued) 


Effectiveness 


The WWC considers the extent of evidence for dialogic 
reading to be small for communication and language competen- 
cies for children with disabilities. No studies that meet WWC 
evidence standards with or without reservations examined the 


effectiveness of dialogic reading for children with disabilities in 
the domains of cognitive development, literacy, math competen- 
cies, social-emotional development and behavior, functional 
abilities, or physical well-being. 


Findings 

The WWC review of interventions for Early Childhood Education 
Interventions for Children with Disabilities addresses student 
outcomes in seven domains: cognitive development, communi- 
cation and language competencies, literacy, math competencies, 
social-emotional development and behavior, functional abilities, 
and physical well-being. The studies included in this report 
cover one domain: communication and language competencies. 
The findings below present the authors’ estimates and WWC- 
calculated estimates of the size and the statistical significance 
of the effects of dialogic reading on children with disabilities. 8 

Communication and language competencies. Two studies 
examined outcomes in the domain of communication and 
language competencies for children with disabilities; one of 
these showed statistically significant positive effects, according 
to WWC criteria. 9 

Crain-Thoreson and Dale (1999) analyzed group differences 
for dialogic reading implemented by a parent and a comparison 
group. The authors did not find statistically significant differ- 
ences between the parent-led intervention and the comparison 
group on any of the measures. The WWC did not find statistically 
significant differences on any measure, and the average effect 
was not large enough to be called substantively important and 
positive, according to WWC criteria (that is, at least 0.25). 


Dale et al. (1996) found a statistically significant difference 
favoring children in the dialogic reading group on lexical diver- 
sity, but no statistically significant differences between groups 
on measures of mean length utterance and number of child 
utterances. 10 The authors combined measures taken during a 
book-reading activity and a play activity, but the WWC separated 
outcomes by type of activity (book-reading or play) to calculate 
group differences on six outcomes. According to WWC calcula- 
tions, there were statistically significant differences between the 
intervention and comparison groups on two of the six measures 
(lexical diversity during the play activity and total number of 
utterances during the book-reading activity). 

Rating of effectiveness 

The WWC rates the effects of an intervention in a given outcome 
domain as positive, potentially positive, mixed, no discernible 
effects, potentially negative, or negative. The rating of effective- 
ness takes into account four factors: the quality of the research 
design, the statistical significance of the findings, the size of 
the difference between participants in the intervention and the 
comparison conditions, and the consistency in findings across 
studies (see the WWC Procedures and Standards Handbook, 
Appendix E). 


8. The level of statistical significance was reported by the study authors or, when necessary, calculated by the WWC to correct for clustering within class- 
rooms or schools and for multiple comparisons. For an explanation, see the WWC Tutorial on Mismatch. For the formulas the WWC used to calculate 
the statistical significance, see WWC Procedures and Standards Flandbook, Appendix C for clustering and WWC Procedures and Standards Handbook, 
Appendix D for multiple comparisons. For the dialogic reading studies summarized here, no corrections for clustering were needed; however, correc- 
tions for multiple comparisons were needed, so the significance levels may differ from those reported in the original studies. 

9. Process-oriented outcomes measuring the children’s engagement in the tasks— called “partic” in Crain-Thoreson and Dale (1999) and “verbal engage- 
ment” or “total engagement” in Dale et al. (1996)— are excluded from this report. 

10. The study also did not find a statistically significant difference on verbal engagement, which the WWC considers a process-oriented outcome and 
excludes from the review. 
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Improvement index 

The WWC computes an improvement index for each individual 
finding. In addition, within each outcome domain, the WWC 
computes an average improvement index for each study and an 
average improvement index across studies (see WWC Proce- 
dures and Standards Handbook, Appendix F). The improvement 
index represents the difference between the percentile rank 
of the average student in the intervention condition and the 
percentile rank of the average student in the comparison condi- 
tion. Unlike the rating of effectiveness, the improvement index is 
entirely based on the size of the effect, regardless of the statisti- 
cal significance of the effect, the study design, or the analysis. 
The improvement index can take on values between -50 and 
+50, with positive numbers denoting favorable results for the 
intervention group. 


The average improvement index for communication and 
language competencies for children with disabilities is +11 per- 
centile points across the two studies, with a range of -2 to +45 
percentile points across findings. 

Summary 

The WWC reviewed 59 studies on the use of dialogic reading 
for children with disabilities. Two studies meet WWC evidence 
standards; the remaining 57 studies do not meet either WWC 
evidence standards or eligibility screens. Based on the two stud- 
ies, the WWC found potentially positive effects of dialogic reading 
on communication and language competencies for children with 
disabilities. The conclusions presented in this report may change 
as new research emerges. 
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Appendix 


Appendix A1.1 Study characteristics: Crain-Thoreson & Dale, 1999 1 (randomized controlled trial) 


Characteristic 

Description 

Study citation 

Crain-Thoreson, C., & Dale, P. S. (1999). Enhancing linguistic performance: Parents and teachers as book reading partners for children with language delays. Topics in Early 
Childhood Special Education, 19(1), 28-39. 

Participants 

The study began with 37 children. All children were eligible for early childhood special-education services and had mild to moderate language delays. Based on pretest scores, 
triads of children with similar receptive vocabulary scores were formed within each district. Within each triad, one member was randomly assigned to a parent dialogic reading 
group, one member was assigned to a staff dialogic reading group, and one was assigned to a control condition. Thirteen children were assigned to the staff-implemented 
group, which was not included in this review, and five more children did not complete the study, leaving 19 children remaining in the sample. The mean age of all the children 
who completed the study was 51 .6 months (ranging from 39 to 66 months), and 31 .3% of these children were female. 2 The mean age of children in the sample included in 
this review was 50.5 months. 

Setting 

The study took place in five classrooms in five schools in three school districts in the Pacific Northwest. Children attended publicly funded preschool programs that provided 
early intervention for children with special needs. 

Intervention 

The study included two intervention groups: one in which program staff implemented dialogic reading, and another in which parents implemented dialogic reading. The 
comparison between the staff-implemented group and the no-treatment comparison group did not meet evidence standards because of high differential attrition and lack of 
baseline equivalence and is excluded from this report. Dialogic reading was implemented over an eight-week period, during which staff or parents engaged in book reading 
with individual children at least four times per week. 

Comparison 

Children in the control group did not participate in dialogic reading. They participated in group story time, which was the standard practice. 

Primary outcomes 
and measurement 

The primary outcome domain was children's communication and language competencies, measured by three nonstandardized measures and two standardized measures. The 
nonstandardized measures included mean length of utterances, number of utterances, and number of different words used (lexical diversity). Children’s vocabulary knowledge 
was measured by two standardized tests: the Peabody Picture Vocabulary Test-Revised and the Expressive One-Word Picture Vocabulary Test-Revised. For a more detailed 
description of these outcome measures, see Appendix A2. 

Staff/teacher/parent training 

Parents were trained in the dialogic reading program during two 90-minute instructional sessions held four weeks apart. Videotape training, live demonstration, and role-play 
were used during the training. Handouts summarizing the training components were provided to parents. The researchers modified the parent training program to address the 
needs of students with language delays by teaching parents to pause and give their children time to respond. 


1. The Crain-Thoreson and Dale (1999) study was previously reviewed for the WWC’s intervention report on dialogic reading conducted as part of the Early Childhood Education (ECE) review of 
interventions for the general population. The parent-implemented intervention group was excluded from the previous report, because the ECE review focused exclusively on center-based inter- 
ventions. The Early Childhood Education Interventions for Children with Disabilities topic area includes both center-based and home-based interventions in the review. For the current report, we 
report only the comparison between the parent-implemented intervention group and the no-treatment comparison group. The comparison between the staff-implemented intervention group and 
the no-treatment control group did not meet evidence standards because of high differential attrition and lack of baseline equivalence and is excluded from this report. 

2. Crain-Thoreson and Dale (1999) report the mean age of children in all three groups (staff-implemented dialogic reading, parent-implemented dialogic reading, and no-treatment control) who 
completed the study. The comparison between the staff-implemented group and the no-treatment comparison group did not meet evidence standards because of high differential attrition and 
lack of baseline equivalence and is excluded from this report. 
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Appendix A1.2 Study characteristics: Dale, Crain-Thoreson, Notari-Sy verson, & Cole, 1996 (randomized controlled trial) 


Characteristic 

Description 

Study citation 

Dale, P. S., Crain-Thoreson, C., Notari-Syverson, A., & Cole, K. (1996). Parent-child book reading as an intervention technique for young children with language delays. Topics 
in Early Childhood Special Education, 16(2), 21 3-235. 

Participants 

Thirty-three mother-child dyads were recruited over a two-year period from an early childhood education center. The children were ages three to six and had mild to moderate 
language delays, functioning at the two- to four-year-old level; 27% of the sample was female. Average baseline test scores on the Peabody Picture Vocabulary Test-Revised 
were more than 2 standard deviations below the normed mean. English was the primary language for all dyads. The dyads were assigned randomly either to dialogic reading 
or to the comparison condition, the Conversational Language Training Program. 

Setting 

Study participants were recruited from programs at the Experimental Education Unit at the University of Washington. Parent training sessions were conducted in small groups 
in therapy/lab rooms. 

Intervention 

Parents attended two training sessions with their children, where they viewed a videotaped presentation of effective ways of facilitating language development through reading 
and then had a brief group discussion. Modules helped facilitate appropriate parental feedback to children during book reading. The intervention included handouts that sum- 
marized each of the modules and included examples. Parents were asked to implement the intervention at home over a six- to eight-week period. Books and handouts were 
given to parents to take home with them. Researchers were unable to assess the consistency of parental implementation of this program. 

Comparison 

The comparison program, the Conversational Language Training Program, was designed to be comparable both in presentation and in general nature to the intervention but did 
not include books. Both the intervention and the comparison program emphasized an interactive, responsive style of communication with children. Parents in the comparison 
group attended two training sessions in which they viewed videotapes, received handouts, were given one of two toys, and were asked to implement the comparison program 
at home over a six- to eight-week period. 

Primary outcomes 
and measurement 

The primary outcome domain was children's communication and language competencies. The study used three nonstandardized measures of communication and language 
competencies: mean length utterance, number of different words used (lexical diversity), and total number of utterances. The study used these measures for two types of 


activities: book reading and play. For a more detailed description of these outcome measures, see Appendix A2. 

Staff/teacher/parent training Parents were trained in dialogic reading in two sessions. Training included a videotaped presentation, group discussion, and handouts summarizing program components. 
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Appendix A2 Outcome measures for the communication and language competencies domain 


Outcome measure 1 

Description 

Peabody Picture Vocabulary 
Test-Revised (PPVT-R) 

A standardized measure of children's receptive vocabulary that requires them to identify pictures that correspond to spoken words (as cited in Crain-Thoreson & Dale, 1999). 

Expressive One-Word 
Picture Vocabulary 
Test-Revised (EOWPVT-R) 

A standardized measure of children's expressive vocabulary that requires them to name pictures of common objects, actions, and concepts (as cited in Crain-Thoreson 
& Dale, 1999). 

Mean length of 
utterances (MLU) 

The number of child utterances during videotaped activity measured using the Computerized Language Analysis Programs (CLAN) (as cited by Crain-Thoreson & Dale, 1999; 
Dale et at, 1996). 

Number of child utterances 

The number of child utterances during videotaped activity measured using CLAN (as cited by Crain-Thoreson & Dale, 1999; Dale et al., 1996). 

Lexical diversity 

The number of different words spoken by the child during videotaped activity measured using CLAN (as cited by Crain-Thoreson & Dale, 1999; Dale et al., 1996). 


1. Process-oriented outcomes measuring the children’s engagement in the tasks— called “partic” in Crain-Thoreson and Dale (1999) and “verbal engagement” or “total engagement” in Dale et al, 
(1996)— are excluded from this report. 
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Appendix A3 Summary of study findings included in the rating for the communication and language competencies domain 1 


Authors’ findings from the study 
Mean outcome 


Outcome measure 

Study 

sample 

Sample size 
(children) 

(standard deviation) 2 


WWC calculations 


Dialogic reading 
group 3 

Comparison 

group 

Mean 

difference 4 
(Dialogic reading 
- comparison) 

Effect 

size 5 

Statistical 
significance 6 
(at a = 0.05) 

Improvement 

index 7 


PPVT-R 

Crain-Thoreson & Dale, 1999 (randomized controlled trial) 8 - 

3-5 year olds 19 61.10 62.00 

(16.50) (16.20) 

-Parent-led implementation 

-0.90 -0.05 

ns 

-2 

EOWPVT-R 

3-5 year olds 

19 

74.80 

(12.10) 

71.00 

(10.60) 

3.80 

0.32 

ns 

+12 

Mean length utterance 

3-5 year olds 

19 

2.75 

(0.72) 

2.70 

(0.97) 

0.05 

0.06 

ns 

+2 

Total utterances 

3-5 year olds 

19 

38.70 

(10.30) 

35.30 

(21.30) 

3.40 

0.20 

ns 

+8 

Lexical diversity 

3-5 year olds 

19 

49.00 

(13.00) 

48.80 

(38.70) 

0.20 

0.01 

ns 

0 

Average for communication and language competencies 
(Crain-Thoreson & Dale, 1999) 9 




0.11 

ns 

+4 




Dale et al., 1996 (randomized controlled trial) 8 




Total utterances — book reading 

3-6 year olds 

33 

63.80 

40.30 

23.50 

1.67 

Statistically 

+45 




(13.90) 

(13.60) 



significant 


Mean length utterances — book 

3-6 year olds 

33 

2.82 

2.75 

0.07 

0.08 

ns 

+3 

reading 



(0.76) 

(0.90) 





Lexical diversity — book reading 

3-6 year olds 

33 

14.60 

14.60 

0.00 

0.00 

ns 

0 




(12.30) 

(8.30) 





Total utterances — play 

3-6 year olds 

33 

94.50 

92.30 

2.20 

0.06 

ns 

+2 




(36.20) 

(36.40) 






(continued) 
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Appendix A3 Summary of study findings included in the rating for the communication and language competencies domain 1 (continued) 





Authors’ findings from the study 







Mean outcome 
(standard deviation) 2 


WWC calculations 


Outcome measure 

Study 

sample 

Sample size 
(children) 

Dialogic reading Comparison 

group 3 group 

Mean 

difference 4 
(Dialogic reading 
- comparison) 

Statistical 

Effect significance 6 

size 5 (at a = 0.05) 

Improvement 

index 7 


Mean length utterances — play 

3-6 year olds 

33 3.08 

(1.09) 

2.98 

(0.81) 

0.10 

0.10 

ns 

+4 

Lexical diversity — play 

3-6 year olds 

33 75.00 

(20.60) 

54.90 

(22.00) 

20.10 

0.92 

Statistically 

significant 

+32 

Average for communication and language competencies (Dale et al., 1996) 9 



0.47 

ns 

+18 

Domain average for communication and language competencies across all studies 9 



0.29 

ns 

+11 


ns = not statistically significant 

PPVT-R = Peabody Picture Vocabulary Test-Revised 

EOWPVT-R = Expressive One-Word Picture Vocabulary Test-Revised 


1. This appendix reports findings considered for the effectiveness rating and the average improvement indices for the communication and language competencies domain. 

2. The standard deviation across all students in each group shows how dispersed the participants’ outcomes are: a smaller standard deviation on a given measure would indicate that participants 
had more similar outcomes. 

3. The dialogic reading group mean is the sum of the unadjusted comparison group mean and the adjusted mean difference, which accounts for pretest. Standard deviations are unadjusted. 

4. Positive differences and effect sizes favor the intervention group; negative differences and effect sizes favor the comparison group. The mean difference is adjusted for pretest differences 
between the treatment and comparison groups. 

5. For an explanation of the effect size calculation, see WWC Procedures and Standards Handbook, Appendix B. 

6. Statistical significance is the probability that the difference between groups is a result of chance rather than a real difference between the groups. 

7. The improvement index represents the difference between the percentile rank of the average student in the intervention condition and that of the average student in the comparison condition. 
The improvement index can take on values between -50 and +50, with positive numbers denoting favorable results for the intervention group. 

8. The level of statistical significance was reported by the study authors or, when necessary, calculated by the WWC to correct for clustering within classrooms or schools and for multiple compari- 
sons. For an explanation about the clustering correction, see the WWC Tutorial on Mismatch. For the formulas the WWC used to calculate the statistical significance, see WWC Procedures and 
Standards Handbook, Appendix C for clustering and WWC Procedures and Standards Handbook, Appendix D for multiple comparisons. For the two dialogic reading studies summarized here, 
no corrections for clustering were needed; however, corrections for multiple comparisons were needed, so the significance levels may differ from those reported in the original studies. 

9. The WWC-computed average effect sizes for each study and for the domain across studies are simple averages rounded to two decimal places. The average improvement indices are calculated 
from the average effect sizes. 
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Appendix A4 Dialogic reading rating for the communication and language competencies domain 

The WWC rates an intervention’s effects in a given outcome domain as positive, potentially positive, mixed, no discernible effects, potentially negative, or negative. 1 

For the outcome domain of communication and language competencies for children with disabilities, the WWC rated dialogic reading as having potentially posi- 
tive effects. The remaining ratings (mixed effects, no discernible effects, potentially negative effects, negative effects) were not considered, as dialogic reading was 
assigned the highest applicable rating. 


Rating received 

Potentially positive effects: Evidence of a positive effect with no overriding contrary evidence. 

• Criterion 1: At least one study showing a statistically significant or substantively important positive effect. 

Met. One study found statistically significant positive effects. 

AND 

• Criterion 2: No studies showing a statistically significant or substantively important negative effect and fewer or the same number of studies showing indeterminate 
effects than showing statistically significant or substantively important positive effects. 

Met. No studies showed statistically significant or substantively important negative effects. 

Other ratings considered 

Positive effects: Strong evidence of a positive effect with no overriding contrary evidence. 

• Criterion 1: Two or more studies showing statistically significant positive effects, at least one of which met WWC evidence standards for a strong design. 

Not met. Only one study of dialogic reading showed a statistically significant positive effect. 

AND 

• Criterion 2: No studies showing statistically significant or substantively important negative effects. 

Met. No studies showed statistically significant or substantively important negative effects. 

1. For rating purposes, the WWC considers the statistical significance of individual outcomes and the domain-level effect. The WWC also considers the size of the domain-level effect for ratings of 
potentially positive or potentially negative effects. For a complete description, see the WWC Procedures and Standards Handbook, Appendix E. 
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Appendix A5 Extent of evidence by domain 


Outcome domain 

Number of studies 

Sample size 

Schools/centers 1 

Students 

Extent of evidence 2 

Cognitive development 

0 

na 

na 

na 

Communication/language 

2 

6 

52 

Small 

competencies 





Literacy 

0 

na 

na 

na 

Math competencies 

0 

na 

na 

na 

Social-emotional 

0 

na 

na 

na 

development/behavior 





Functional abilities 

0 

na 

na 

na 

Physical well-being 

0 

na 

na 

na 


na = not applicable/not studied 


1. The number of centers represented in the communication/language competencies domain is an estimate. Crain-Thoreson and Dale (1999) do not report the number of classrooms assigned to each 
condition (three districts, five schools, and five classes were represented in the study). The design of the study makes it likely that all five classrooms were represented in each study condition. 

2. A rating of “medium to large” requires at least two studies and two schools across studies in one domain and a total sample size across studies of at least 350 students or 14 classrooms. 
Otherwise, the rating is “small.” For more details on the extent of evidence categorization, see the WWC Procedures and Standards Handbook, Appendix G. 
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